It's Written on Your Face: Detecting Affective States from Facial Expressions while Learning Computer Programming
نویسندگان
چکیده
We built detectors capable of automatically recognizing affective states of novice computer programmers from student-annotated videos of their faces recorded during an introductory programming tutoring session. We used the Computer Expression Recognition Toolbox (CERT) to track facial features based on the Facial Action Coding System, and machine learning techniques to build classification models. Confusion/Uncertainty and Frustration were distinguished from all other affective states in a student-independent fashion at levels above chance (Cohen’s kappa = .22 and .23, respectively), but detection accuracies for Boredom, Flow/Engagement, and Neutral were lower (kappas = .04, .11, and .07). We discuss the differences between detection of spontaneous versus fixed (polled) judgments as well as the features used in the models.
منابع مشابه
Facial Features for Affective State Detection in Learning Environments
This study investigated facial features to detect the affective states (or emotions) that accompany deep-level learning of conceptual material. Videos of the participants’ faces were captured while they interacted with AutoTutor on computer literacy topics. After the tutoring session, the affective states (boredom, confusion, delight, flow, frustration, and surprise) of the student were identif...
متن کاملAutomatically Recognizing Facial Expression: Predicting Engagement and Frustration
Learning involves a rich array of cognitive and affective states. Recognizing and understanding these cognitive and affective dimensions of learning is key to designing informed interventions. Prior research has highlighted the importance of facial expressions in learning-centered affective states, but tracking facial expression poses significant challenges. This paper presents an automated ana...
متن کاملFacial Expression Recognition Based on Anatomical Structure of Human Face
Automatic analysis of human facial expressions is one of the challenging problems in machine vision systems. It has many applications in human-computer interactions such as, social signal processing, social robots, deceit detection, interactive video and behavior monitoring. In this paper, we develop a new method for automatic facial expression recognition based on facial muscle anatomy and hum...
متن کاملCluster-analytic classification of facial expressions using infrared measurements of facial thermal features
In previous research, scientists were able to use transient facial thermal features extracted from Thermal Infra-Red Images (TIRIs) for making binary distinction between the affective states. For example, thermal asymmetries localised in facial TIRIs have been used to distinguish anxiety and deceit. Since affective human-computer interaction would require machines to distinguish between the sub...
متن کاملAutomatic Emotional State Detection using Facial Expression Dynamic in Videos
Human face provides an essential, spontaneous channel for the communication of mental states. In addition to functioning as a conversation enhancer, facial expressions directly communicate feelings, cognitive mental states, and attitude toward other people. Automatic emotional state detection from facial expression videos is to identify and understand the emotional state of a person as shown in...
متن کامل